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Statement of Focus 



The Wisconsin Research and Development Center for Cognitive 
Learning focuses on contributing to a better understanding of cognitive 
learning by children and youth and to the improvement of related educa- 
tional practices. The strategy for research and development is compre- 
hensive. It includes basic research to generate new knowledge about 
the conditions and processes of learning and about the processes of 
instruction, and the subsequent development of research-based instruc- 
tional materials, many of which are designed for use by teachers and 
others for use by students. These materials are tested and refined in 
school settings. Throughout these operations behavioral scientists, 
curriculum experts, academic scholars, and school people interact, 
insuring that the results of Center activities are based soundly on know- 
ledge of subject matter and cognitive learning and that they are applied 
to the Improvement of educational practice. 

Tnis Technical Report is from the Quality Verification Program, 
whose principal function is to identify and invent research and devel- 
opment strategies taking into account current knowledge in the field 
of statistics, psychometrics and computer technology. The Quality 
Verification Program collaborates in applying such strategies in re- 
search and development. The translation of theory into practice and 
presentations of exemplars of methodology are challenges which the 
Quality Verification Program strives to meet. 



Contents 



, 

■ 





■ 

► 



i 



i 





\ 



t 




O 




List of Tables 

List of Figures 

Abstract 

I Introduction 

Background 
Previous Evaluations 
Reasons for Present Study 
Goals of the Study 

II The Evaluation Plan 
Subjects 
Method 

Measuring Instruments 

III Analysis of the Data 

Theory 

Preliminary Steps in the Analysis 
Step 1: Grade 
Step 2: Site 

Test of the Main Hypotheses 
Further Analyses 

IV Summary and Discussion 
Appendices 

A. Overview of the Key Mathematical Ideas 
in Patterns in Arithmetic, Grades 1-6 

B. Pre-Questionnaire— September, 1970 

C. Post-Questionnaire— May, 1971 

D. Pretest— September, 1970 

E. Posttests— May, 1971 
PIA-specific content (Questions 1-15) 

Grade 1 
Grade 2 
Grade 3 
Grade 4 

Basic Mathematics (Questions 16-35) 

F. Additional Statistical Tables and Figure 

References 



5 



List of Tables 



Table Page 

1 Approximate Number of Participants in the Study 6 

2 Analysis of Variance: Knowledge 9 

3 Analysis of Variance: Attitude 10 

4 Determination of Covariate Set for Analysis of Covariance: 

Knowledge 1 3 

5 Analysis of Covariance: Knowledge 14 

6 Estimated Parameters for Target Population with and without PIA 16 

7 Analysis of Covariance: Attitude 19 

1- F Sample Mean Scores 94 

2- F Weighted Mean Univariate Analysis of Variance 95 

3- F Estimates of Parameters: Knowledge 96 

4- F Estimates of Parameters: Attitude 97 



List of Figures 

Figure Page 

1 Diagram of the experimental design. 6 

2 Regression of PIA-specific posttest scores on basic mathematics 

pretest scores. 15 

3 Regression of basic mathematics posttest scores on basic mathe- 
matics pretest scores. 15 

4 Performance levels on knowledge and attitude variables for target 

population with and without PIA: Estimated means. 21 

1-F Performance levels on knowledge and attitude variables for experi- 
mental and control teachers: Sample data. 98 



i: 




e 



vii 



Abstract 



A large-scale, summatlve, comparative evaluation of 
Patterns In Arithmetic, a modem televised arithmetic curric- 
ulum for Grades 1-6, was carried out In Grades 1-4 In both 
rural and urban schools during the 1970-71 school year. This 
report deals with the ways in which PIA affects teachers: In 
basic mathematical knowledge, knowledge of PIA-speclflc 
content, and attitudes toward teaching arithmetic. Findings 
Indicate that PIA can be used effectively as ln-servlce educa- 
tion, particularly for those teachers with relatively lower 
initial knowledge of the basic mathematics which underlies 
a contemporary elementary school mathematics program. PIA 
does not seem to change teachers' attitudes, however; nor is 
it beneficial In increasing knowledge of concepts not specifi- 
cally related to PIA. 

These results seem to hold equally for both rural and 
urban schools. 



I 

Introduction 



Background 

Patterns in Arithmetic (PIA) , a comprehen- 
sive elementary mathematics program for Grades 
1-6, originated in 1959 and was developed 
over the next decade under the leadership of 
Professor Henry Van Engen with the support 
of the Ford Foundation and, starting in 1964, 
the Wisconsin Research and Development Cen- 
ter for Cognitive Learning . The components 
of PIA are television lessons on videotape, 
teacher suggestion manuals, and pupil exer- 
cise books. When PIA is used as an instruc- 
tional program, a class watches a 15-minute 
videotaped lesson once or twice a week (the 
schedule varies at different grade levels) and 
the teacher supplements this by using the PIA 
exercise books and suggestions in the PIA 
manual. The normal sequence of events would 
be: a few minutes of pre-telecast warm-up, 
suggestions for which come from the teacher's 
manual; the telecast, during which the pupils 
may be asked by the TV teacher to manipulate 
various objects or work a few problems; post- 
telecast activities, suggested in the manual, 
which enlarge upon or review the important 
concept presented in the telecast; and then, 
over the next few days, supplementary activi- 
ties from the manual and exercises in the 
pupil exercise books, some of which are re- 
lated to material in the telecast and some of 
which are review of concepts presented in 
previous telecasts. Short tests are also given 
a few times a semester so that teachers can 
assess pupil progress. 

PIA was designed to be utilized in the 
period of transition to a modern mathematics 
program at the elementary level. To quote 
Professor Van Engen, 

Remember that the telecasts are not in- 
tended to replace the classroom teacher. 

They are intended to help introduce and 

demonstrate new mathematical ideas. 



You, the teacher, are still the most impor- 
tant element in the development of a sound 
and meaningful mathematics program in 
your school. . . .PIA is one answer to a new 
program in mathematics, but after having 
used PIA for a year or two, you will be 
ready to find other answers for your school. 
Whatever happens, remember that change 
is inevitable. You must help determine 
the direction of that change. 1 

The dual objectives of PIA are to provide 
a sound program in mathematics for the elemen- 
tary school child and to provide in-service 
education for the elementary school teacher. 
Television was chosen as the medium by which 
to accomplish these aims, particularly for pu- 
pils and teachers in rural areas, where distance 
and sparse population often make it difficult to 
carry out in-service meetings or visits, and in 
the centers of large cities, where high turnover 
in both pupil and teacher populations and other 
familiar ills frequently make educational stabil- 
ity and quality difficult to achieve. 

For more complete information on the history, 
mathematical content, behavioral objectives, and 
pedagogical principles of PIA, see Braswell and 
Romberg (1969) . For an overview of the key 
mathematical ideas in PIA, see Appendix A. 

Previous Evaluations 

As part of the research and development 
effort, a summative, noncomparative evaluation 
of the PIA program in Grades 1 and 3 was car- 
ried out during the 1966-67 school year (Bras- 
well & Romberg, 1969). Several hundred first- 



*From the preface to the Patterns in Arith- 
metic Teacher's Manuals . 
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and third-grade classrooms In Alabama and 
Wisconsin took part In the study, carried out 
In communities of four different sizes, the two 
largest of which were further broken down Into 
three socioeconomic levels. Very briefly, the 
results of that study indicated that most of the 
objectives set forth by the PIA staff were being 
accomplished. In addition, further analysis 
revealed no relation between performance and 
community size or socioeconomic level. The 
only difference appeared to be between the 
two states, and then only on the standardized 
computation test. 

A field test for Grade 2 was carried out 
in the 1967-68 school year (Braswell, 1969a). 
Again the results indicated that PIA was accom- 
plishing most of its goals . At the end of the 
school year, the children in the 30 classes 
in the study scored significantly higher than 
the norms on a standardized test of concepts 
for that grade level, despite having scored 
lower than the norms group at the beginning 
of the year. 

A formative evaluation of the PIA program 
for Grade 5, with about 80 classes participat- 
ing, was also carried out in 1967-68 (Braswell, 
1 9 69b) . Results indicated that children learned 
traditional computation skills and important 
concepts in arithmetic commensurate with their 
stage of development. Computation problems 
tended to be easier at the end of the school 
year than they were shortly after the skills 
were presented, which is good evidence that 
skills learned early in the year are not forgot- 
ten, but are reinforced by the structure of the 
PIA pupil exercise books. 

In the 1968-69 school year, the PIA staff 
at the Wisconsin Research and Development 
Center for Cognitive Learning conducted a 
formative evaluation of the PIA program for 
Grade 6 (Braswell, 1970). The study success- 
fully used the techniques of item sampling to 
evaluate the year's curriculum. This evalua- 
tion engendered several specific improvements 
in the telecasts. 



Reasons for Present Study 

One of the original objectives in devel- 
oping PIA was to provide in-service education 
for elementary school teachers, but none of 
the evaluations mentioned heretofore had 
investigated the effectiveness of PIA in this 
respect. Moreover, no evaluation of Grades 
1-3 had been carried out following revision 
of the teacher's manuals for these three grades. 
The original manuals had been judged by teach- 
ers to be of limited use,, and the revised ver- 



sions included, for each telecast: a statement 
of behavioral objectives, a description of the 
mathematical background for the topics to be 
covered, an overview of the program itself, 
and specific descriptions of what to do prior 
to the telecast; the materials to be used by 
students during the telecast, what goes on 
in the television program itself, and what to 
do after the telecast is completed. 

In addition, as a result of feedback re- 
garding utilization of PIA in various settings, 
a need was felt to ascertain the effectiveness 
of PIA among rural and urban children, and 
again none of these studies had focused on 
this particular question. Thus a large-scale, 
summative, comparative evaluation was car- 
ried out in the 1970-71 school year, focusing 
both on teachers and on rural and urban pupils 
in Grades 1-4. (The study would have been 
extended longitudinally to Grades 5 and 6 were 
it not for limited funds.) 

The attribute of a rural setting which makes 
televised education promising is the fact that 
many teachers have not had recent opportunity 
to update their skills. Thus, used properly— 
with the teachers viewing the program as their 
pupils see it— PIA becomes an in-service pro- 
gram in the concepts and pedagogy of modern 
mathematics. Both teachers and pupils learn 
the new ideas through the medium of television 
from qualified teachers presenting contemporary 
mathematics content. 

Urban settings are often characterized by 
high transiency of pupils, and even teachers, 
within the school district. A televised program, 
in addition to being a familiar and appealing 
medium, provides for continuity in the basic 
skills program and is an educational touchstone 
for the transient pupils . Moreover, since 
urban children are frequently deficient in the 
reading skills required for efficient learning 
from mathematics textbooks, television pro- 
grams in which manipulation of concrete mate- 
rials is a key feature may be a particularly 
effective means of presenting new concepts. 

There are some factors, of course, which 
are Important in both types of demographic 
situations— television's appeal to children 
and its efficiency and economy as an in-ser- 
vice course . 



Goals of the Study 

In general, the data can be evaluated from 
three approaches: the effects of PIA on pupils, 
on teachers, and the Interaction between the 
two. This report will concern itself only with 
the second kind: in what ways, if any, are 
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teachers affected by using PIA In their class- 
rooms ? Other reports In preparation will deal 
with the other two aspects. 

The objectives to be dealt with In this 
report are: 



1 . Do teachers who use PIA increase 
their knowledge of modern mathe- 
matics; l.e,, Is PIA an effective In- 
service course? 

2. Do teachers who use PIA become more 
positively disposed toward teaching 
mathematics, l.e., enjoy It more or 
become more confident? 



3. Does the effect of PIA on teachers' 
knowledge vary with the 

a. demographic characteristics of 
the school? 

b. grade level taught? . 

c. level of teachers' Initial general 
knowledge of the mathematics 
which underlies contemporary 
arithmetic ? 

4. Does the effect of PIA on teachers' 
attitudes vary with these same three 
factors? 



II 

The Evaluation Plan 



Sub) *'■ 

* experiment was designed to be carried 
out in urban and rural areas. Urban districts 
selected were New York archdiocese schools, 
Chicago public schools, and the Portland, 
Oregon, school system. Rural sites were lo- 
cated in the state of Vermont and in three rural 
counties near Roanoke, Virginia. Within each 
of the five sites, schools willing to partici- 
pate were identified and were randomly assigned 
to the experimental or the control group. In the 
experimental schools, PIA was to be used as 
the major or sole component in the mathematics 
curriculum. 

Approximately 10,000 children and 400 
teachers in about 85 schools took part in the 
study. Because of various unforeseen reasons, 
some of which are explained later, this sample 
was reduced somewhat in the data analysis, 
but the numbers in the analysis are still of 
the same order of magnitude. Table 1 indicates 
which grades participated in which sites, and 
gives approximate numbers of children, teach- 
ers and schools in each site. It is sufficient 
to note that within each site there wefe approx- 
imately equal numbers of experimental and con- 
trol schools. In those sites where more than 
one grade level participated, there were ap- 
proximately equal numbers of classes in each 
grade. 



Method 

Classes in the experimental schools used 
the Patterns in Arithmetic programs as their 
sole or major component in the mathematics 
curriculum. This included the television pro- 
grams, pupil exercise books, and the teacher's 
manuals, all described earlier. 

Classrooms in the control schools pro- 
ceeded normally through the school year with 



whatever mathematics curriculum they chose 
to use. Although teachers in control school 
classrooms were encouraged not to use the 
PIA telecasts , they were not prevented from 
doing so if they chose; in fact, some of the 
teachers did use the PIA telecasts, but gener- 
ally as a supplement to another curriculum. 



Measuring Instruments 

At the beginning of the 1970-71 school 
year, teachers from both experimental and 
control schools attended an informational 
meeting. At this time, data were gathered by 
means of a questionnaire and a test ol ele- 
mentary mathematics. Near the end of the 
year, the participants were asked to fill out 
a second questionnaire and take a posttest. 

The preliminary questionnaire, which 
follows as Appendix B, asked for biographical 
data, length and kind of teaching experience, 
and information about the recency and extent 
of training in mathematics and modern arith- 
metic concepts. Also Included were questions 
about how much the teacher enjoyed teaching 
arithmetic compared with other subjects, and 
how confident the teacher felt when teaching 
the more difficult concepts of arithmetic. fThe 
term "more difficult" was not defined, but 
rather left to the individual teacher's subjec- 
tive judgment.) 

The post-questionnaire, Appendix C, 
asked for information about the extent to which 
the PIA telecasts and supplementary materials 
were used and for teachers' opinions as to the 
appropriateness and effectiveness of the PIA 
package for their pupils, and their desire to 
use the program again next year. Two ques- 
tions from the pre-questionnaire about the 
teacher's enjoyment of and confidence in 
teaching arithmetic were also Included, so 
that attitudinal changes could be measured. 
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Table 1 

Approximate Number of Participants In the Study 



Site 


1 


Grade Level 
2 3 


4 


Schools 


Teachers 


Pupils 


New York 






X 


X 


40 


150 


4700 


Chicago 


X 


X 






10 


90 


2350 


Portland* 


X 


X 






10 


40 


850 


Vermont 


X 


X 


X 




10 


70 


1650 


Virginia 








X 


15 


40 


1050 




TOTAL 






85 


390 


10600 



*Data not used In analysis. 



The 50-ltem pretest, Appendix D, measured 
how familiar the teacher was with the basic 
mathematical concepts which underlie a con- 
temporary elementary mathematics program. 
There were Items on sets, number, numerals, 
numeration systems, operations, properties, 
Informal geometry, and a few other topics or 
combinations of these topics. The Intent of 
the test was not to measure those concepts 
or vocabulary In the PIA telecasts, but rather 
to get a broad measure of concepts basic to 
any modern approach to mathematics. The 
Items were chosen from two sources: the SMSG 
Film— Film Text Evaluation Study Mathematics 
Inventory (School Mathematics Study Group, 
1963) and the Sets and Systems Achievement 
Tests I-V (Educational Testing Service, 1964). 

The test taken In May, 1971 (Appendix 



E) consisted of two parts: 15 Items specially 
constructed to measure the specific content 
from the year's PIA telecasts; and a 20-ltem 
posttest, culled from the pretest on the bases 
of Item analysis statistics and PIA/grade level 
content appropriateness. Although the 15-ltem 
PIA tests were constructed to measure only 
PIA content, care was taken to Include only 
those concepts or vocabulary which control 
(non-PIA) teachers could reasonably be ex- 
pected to have encountered In any general 
exposure to the basic concepts underlying 
modern arithmetic. These 15 Items (PIA Tests 
1, 2, 3, and 4) were necessarily different for 
the r.ost part for the four grade levels, 1-4, In 
the experiment. However, the 20 Items culled 
from the pretest were the same for all four grade 
levels. A diagram of the design follows: 



Grade September 1970 1970-71 School Year Mav 1971 



1 






During the school year 




PIA 
Test 1 
















2 






the experimental schools 




PIA 

Test 2 






pre- 


pre- 

test 




post- 

question- 


post- 

test 2 


3 


question- 


used PIA In the classroom; 


PIA 
Test 3 




nalre 






nalrel 


(20 Items) 


4 




the control schools used 


PIA 
Test 4 














their regular math program. 









^Two attitudinal questions In the pre-questionnaire were repeated In the post-questionnaire. 



• 2 Posttest Items were Imbedded In tho pretest. 



Fig. 1 . Diagram of the experimental design. 
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AMlysis of Mm Data 



Thaary 

We defined target population to be all 
teachers in the sites from which the data were 
sampled, as well as in sites to which the re- 
sults of the study could reasonably be gener- 
alized. As such, the ultimate questions of 
research interest were stated in terms of two 
null test hypotheses: 

1. If teachers in the target population 
use PIA, there will be no effect on 
their knowledge either of PIA content 
or of the basic general mathematical 
concepts and procedures (henceforth 
called "basic mathematics") which 
underlie contemporary mathematics 
for the elementary school . 

2. If teachers in the target population 
use PIA, there will be no effect on 
either confidence in or enjoyment of 
teaching elementary school mathe- 
matics . 

To determine the plausibility of the two 
hypothrses, two sources of data were avail- 
able. One was a randomly selected sample 
from the target population who had not used 
PIA (the control group) but whose schools were 
willing to participate in the evaluation. The 
sample statistics from this source provided 
estimates of knowledge and attitudes exist- 
ing in the target population at the end of the 
study. A second sample was similarly select- 
ed from the same original target population, 
but the teachers therein were exposed to PIA 
during the school year (the experimental group) . 
The sample statistics from this tource provided 
estimates of knowledge and attitudes at the end 
of the study that would have obtained had all 
teachers in the target population used PIA in 
the classroom. 



If PIA had no effect, then these two data 
samples come from the same theoretical pop- 
ulation and thus would yield the same perfor- 
mance levels and attitudes within the limits 
of sampling and measurement errors. Because 
of the random assignment to experimental or 
control groups of schools within each site 
and because measurement and sampling error 
distributions can be well-approximated by 
fairly simple statistical models, it was thus 
possible to compute statistical tests of the 
hypotheses listed above. 



Preliminary Slept in the Analysis 

The school was the unit of analysis since 
schools within a site were randomly assigned 
to either the experimental or control group. 

An advantage of using the mean for a school 
as the statistic of analysis, besides its con- 
venient statistical properties, was the fact 
that if gain score means were used we would 
not need to be concerned about teacher turn- 
over during the study: we could obtain un- 
biased estimates of unit (school) performance 
and unit gains regardless of whether the per- 
sonnel changed (in some schools the personnel 
turnover was 50% in the grades studied). 

Grade level was one type of grouping of 
teachers within units , and is a within-unit 
source of variation. A second type of group- 
ing, within the sample as a whole, was site , 
another source of variance. Performance levels 
and/or attitudes might be expected to vary with 
both of these factors. This would be of no con- 
sequence to subsequent analysis if neither fac- 
tor altered the effect of PIA on teachers' behav- 
ior, as measured vrith the present instruments, 
but if such Interactions existed, it was con- 
sidered to be Important to discover and report 
them. Thus the first two steps in the analysis 
were done to determine whether the effect of 
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PIA on teachers varies by grade level or site . 
If the findings were negative, the statistical 
model for further analysis could be greatly 
simplified. 



Step 1 1 Grade 

Not all four grade levels were represented 
within any one site— the number was either 
one, two. or three (see Table 1, p. 6). How- 
ever, sampling was dono randomly within 
each site and resulted in essentially equal 
numbers of schools (and therefore all classes 
within a school) assigned to the experimental 
and control treatments by grade. Thus, grade 
and treatment were well balanced within each 
site. 

If, within a site, PIA's effect did not seem 
to vary with grade level, grade could be ig- 
nored by averaging the grade means within 
each school. This would result in but one 
statistic (for each variable) for each school, 
and would simplify procedures still further 
and make hypothesis testing more powerful. 

Multivariate repeated measures analyses 
of variance (with grade as the repeated mea- 
sure) were used to test the hypotheses that 
the Grade x Treatment interaction effects are 
zero for each variable (Table 2). The depen- 
dent variables here, as elsewhere, deal with 
knowledge of mathematics and attitudes toward 
teaching it. The results, a multivariate sig- 
nificance level of 0.68, showed the hypoth- 
esis concerning knowledge is not unreason- 
able; in fact, the evidence against tha hypoth- 
esis was not even of moderate strength. The 
same results (significance level of 0.76—see 
Table 3, p. 10) obtained with the hypothesis 
using attitude as the variate. 2 



2For this multivariate analysis step, an 
unweighted mean was used for arriving at a 
representative score for each school. Since 
it was thought that using a weighted mean 
(weighted according to the number of classe& 
in the school) might alter the results, a more 
expensive second analysis, using the univari- 
ate repeated measures approach with weight- 
ed means, was carried out. The results were 
nearly Identical (See Table 2-F, Appendix F). 
Hence, for further analysis, the mean score 
for each school la determined by the simpler, 
unweighted, method. 



Thus there was no reason to reject the 
hypothesis that Grade x Treatment interaction 
is zero for either the knowledge or the attitude 
variable; we can safely continue the analysis 
on the assumption that the effects of PIA on 
teachers' knowledge and attitudes does not 
vary with grade, and can proceed with the 
above-mentioned simplifications in the analy- 
sis model. 



Step 2: Site 

We now proceed to determine whether the 
effect of PIA varies according to site .3 If it 
can be assumed that the Site x Treatment inter- 
action effect is zero, then the analysis model 
can again be simplified and certain Inferences 
may be made with greater precision . For each 
site, a weighted mean of the estimates of 
treatment effect (school means), where the 
weights are inversely proportional to the vari- 
ances of the estimates, was used as the statis- 
tic in the analysis; this statistic, under the 
assumption of zero Site x Treatment interaction, 
has the smallest variance of all unbiased linear 
estimators, and therefore enhances precision. 
(For example, the mean from New York, as the 
site with the most cases [schools], would be 
given most weight.) 

Since the assumption of zero interaction 
is the key to the final statistical model, the 
reasonableness of this hypothesis must be in- 
vestigated. This was done in two ways: 
through the classical analysis of variance 
approach involving a test of this hypothesis, 
and by examination of "residuals," l.e., the 
differences between the values that would 
obtain if the model holds true and the actual 
values observed in the data samples , for each 
combination of site and treatment. 



^The proportion of incomplete and missing 
data in the Portland, Oregon, site was so large 
as to make the supposed randomisation process 
highly suspeot. Hence these data were dis- 
carded and not used in any of these analyses. 
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Table 2 

Analysis of Variance: Knowledge 



Dependent Variables: (1) PIA-Specific Posttest Score 

(2) Basic Mathematics Posttest Score 



Source 




Results 

Univariate Results** 
PIA-Specific Basic Math 

JIB MS £ 



Direction 
If Relevant 



JL 



Mean 

Among Schools 8 


1 

72 


— 


5521.89 


— 


— 


12627.29 


— 





Among Sites 


3 


,0053* 


2.036 


0.65 


.59 


38.82 


5.06 


.0033* 


Treatment (PIAvs. 


Control)* 3 


1 


.009* 


26.39 


8.39 


.0052 5.043 


0.66 


.42 PIA higher 


Treatment x Site 


3 


.23 


6.189 


1.97 


.13 


9.112 


1.19 


.32 


Among Schools 


Within Cells 0 


65 


— 


3.146 


— 


— 


7.676 


— 


— 


Within Schools 


66 


— 


— 


--- 


... 


— 


— 


— 


Grades Specific 


to Sites 


4 


.55 


7.007 


1.56 


.20 


2.525 


0.31 


.87 


Treatment x Grades 


Specific to Sites 


4 


.68 


2.452 


0.54 


.70 


7.968 


0.97 


.43 


Grade x Schools 


Within Cells 


58 




4.501 






8.240 


••• 





•Statistically significant with 0.0S level as criterion. 



a Analysls performed using unweighted average of grade means in each school. 

^Assumes Treatment x Site and Treatment x Grade specific to site effects are negligible but any 
potential site effects have been eliminated. 

°Used as error for Among Schools Analysis. 

<*If multivariate test is significant, univariate tests are performed with modified Roy-Bose tech- 
nique: in this case, the requirement simplifies to use of ordinary F ratios shown. 
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Table 3 

Analysis of Variance: Attitude 

Dependent Variables: (1) Enjoyment of Teaching Mathematics 

(2) Confidence In Teaching Mathematics 



Source 




Results 

Univariate Results 
Enjoyment Confidence 

MS 



Direction 
If Relevant 



Mean 

Among Schools^ 
Among Cells 


1 

72 

7 


— 


— 


— 


— 


— 


— 


— 


Among Sites 


3 


.17 


5.787 


81.45 


.24 


5.650 


1.67 


.18 


Between Treatments^ 


1 


.54 


1.468 


0.37 


.55 


1.674 


0.49 


.48 


Treatment x Site 


3 


.35 


1.598 


70.40 


.75 


1.259 


0.37 


.77 


Within Cells 0 


65 


— 


3.980 


— 


— 


3.384 


— 


— 


Within Cells 

Within Schools 

Grades Specific to 


65 

66 


.0006* 


7.611 


2.89 


.0001* 


6.468 


1.18 


.26 


Sites 

Treatment x Grades, 


4 


.93 


1.669 


0.63 


.64 


1.103 


0.20 


.94 


Specific to Sites 


4 


.76 


2.487 


0;94 


.44 


1.699 


0.31 


.87 


Grade x Schools (error) 


58 


— 


2.633 


— 


— 


5.482 


— 


— 



^Statistically sign If leant, with 0.05 level as criterion. 

a Analysls performed using unweighted average of grade means In each school. 
bAfter any site effects are removed; assumes Treatment x Site effects are zero, 
cused as error for Among Schools Analysis. 
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For knowledge,** the hypothesis of no 
Site x Treatment interaction was not rejected 
(Table 2). The F test attained a multivariate 
significance level of .23, well above the .05 
level for clear rejection or the .05-. 15 range 
indicative of moderate evidence against the 
hypothesis. Using the univariate approach, 
the significance level for the basic mathe- 
matics score was .3 2, well out of the ques- 
tionable range; for the PIA-specific score, it 
was .13, which falls barely within the gener- 
ally accepted area of moderate negative evi- 
dence. Although this in itself was not enough 
to reject the hypothesis, the residuals (sam- 
ple values minus predicted values) for the 
PIA-specific scores were inspected. The 
largest t_ ratio for the residuals was -2.04. 
The effect in this site was the opposite of 
the effect in the others, but the value was 
still below the rather liberal Bonferroni criti- 
cal value of approximately + 2.39, for 3 df 
at alpha = .05, and hence is not statistically 
significant. Thus, for the knowledge vari- 
ables, the hypothesis cannot be rejected and 
the simple statistical model is adequate. 

For the attitude variables, the results 
showed even less reason for rejection of the 
simple model. The multivariate test attained 
the significance level of .35 and the univari- 
ate levels were .75 and .77 for enjoyment 
and confidence, respectively. The t_ ratios 
for all residuals were small. Thus, there is 
not sufficient evidence to compel us to reject 
the hypothesis of no Site x Treatment interac- 
tion for either knowledge or attitude variables; 
the simple statistical model is adequate for 
investigating the main hypotheses stated at 
the beginning of this section. 

Test of the Main Hypotheses 

The testing in May, 1971 yielded 
scores on PIA-specific content and on basic 



^For shorthand convenience, "knowledge” 
stands for investigations of the hypotheses 
concerning variables related to scores on pre- 
test and posttest— in the latter case both the 
PIA-specific test and the basic mathematics. 
Similarly, "attitude" refers to investigations 
of hypotheses concerning confidence in and 
enjoyment of teaching elementary school mathe- 
matics, data for which were gathered from the 
two questionnaires. 



mathematics. Using the simple statistical 
model with the assumption that the effect of 
PIAdoes not vary among grades or sites, both 
of these knowledge variables were investigated. 
The multivariate test attained a significance 
level of .009, well below the necessary .05 
and indicative of strong evidence against the 
null hypothesis (see Table 2) . This Implies 
that using PIA in the classroom changed the 
level of performance on at least one and pos- 
sibly both of the two variables. The univari- 
ate analysis was used to determine which of 
the variables was thus affected. For PIA- 
specific knowledge, the F ratio yielded a 
significance level of .005, well below the .05 
required; there is clear-cut evidence against 
the assumption of zero effect. For basic mathe- 
matics, however, the F ratio yielded a signifi- 
cance level of .42, and thus the assumption 
of no effect on that variable cannot be rejected. 
PIA changes the level of performance in the 
target population on PIA-specific knowledge 
but not, apparently, on other basic mathe- 
matics (see Figure 4, p. 21). 

However, this apparent lack of effect of 
PIA on knowledge of basic mathematics was 
determined using only the posttest scores. A 
better method of investigation is to use the 
pretest scores as well, recalling that all items 
on the posttest were also included in. the pre- 
test. Thus a univariate analysis of variance 
was performed on the gain scores, or differ- 
ences in score from pretest to posttest. This 
method is better in the sense that not only is 
a gain score an unbiased estimate, as is a 
posttest score alone, but also there is less 
variance connected with gain scores, and thus 
results can be obtained with greater precision. 
In a sense, each teacher acts as his own con- 
trol when a gain score is used. 

The F ratio resulting from this ANOVA 
reached a significance level of .003, highly 
indicative that the null hypothesis must be 
rejected (see Table 2, p. 9). When one 
investigates gain scores, PIAdoes affect level 
of knowledge of basic mathematics. However, 
the effect is in a negative direction— the gain 
scores of the target population as a whole are 
larger than for those who used PIA in the class- 
room. 

When attitudes are analyzed, the results 
are less striking. Although the observed dif- 
ferences were negative for enjoyment and posi- 
tive for confidence, neither of these came close 
to being significant (see Table 3) . The attained 
significance level for the multivariate test was 
.54 and the univariate levels were .55 and .48 
for these two variables. 
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Further Analyse* 



While the analysis could end with what 
has been discussed so far, there remains the 
fact that much of the variance In the data 
came from differences among teachers, and 
thus among schools, the units of analysis. 

The precision of various estimates should be 
Increased by eliminating differences associated 
with pretest scores (for the knowledge analysis) 
and beginning attitudes as measured on the pre- 
questionnaire (for the attitudes analysis) . 

Thus analyses of covariance were also 
done. For knowledge, the choice of covari- 
ates was arrived at somewhat empirically: by 
determining the set of covariates which reduces 
the mean square error the most for the least 
proportionate reduction in degrees of freedom 
for error (see Table 4) . The final set of co- 
variates chosen in this manner was the score 
on those pretest items which were also on the 
posttest, dropping the assumption that the 
regression of posttest scores on pretest scores 
is the same regardless of whether teachers 
have used PIA. (This was accomplished by 
using as a variable the pretest subscore for 
the experimental group, and zero for the con- 
trol group.) The use of several other possible 
covariates was examined, but did not prove 
fruitful. 

The results (see Table 5) agreed with 
those from analyses of variance reported earlier. 
The multivariate significance level was .01; 
therefore the hypothesis that PIA has zero effect 
on knowledge must be rejected. Further uni- 
variate investigation revealed that this non- 
zero effect showed up on the PIA-s pacific 
post-scores, but not on the basic mathematics 
post-scores (F test significance levels of 
..045 and .23, respectively). As before, the 
results showed that using PIA in the classroom 
significantly increases knowledge related to 
the PIA content. 

Since dropping the assumption of homo- 
geneity of regression (of knowledge scores 
on pretest basic mathematics score) proved 
useful in the analysis of covariance, the 
hypothesis itself was investigated. The multi- 
variate significance'level was .08, not below 
the .05 level for statistical significance, but 
nonetheless indicative of some evidence 
against the hypothesis (see Table S) . When 
this was further investigated, it appeared 



that there was little difference between exper- 
imental and control groups for regression of 
basic mathematics posttest scores on pretest 
scores, but there was more apparent effect 
on the regression of PIA-specific posttest 
scores on basic mathematics pretest scores 
(see Figures 2 and 3). The regression coeffi- 
cient for the experimental group was estimated 
at .27, while that for the control group was 
.49. This difference, although still only in 
the marginal area statistically— the significance 
level is ,09 r — tends to indicate that among 
those with low to average scores on the basic 
mathematics pretest, using PIA makes a marked 
difference on the PIA-specific posttest when 
compared with the target population as a whole, 
whereas among those with pretest scores more 
than one standard deviation above the mean, 
the effect is just the opposite: using PIA 
produces scores relatively lower than in the 
target population. Restated, the less the 
knowledge of basic mathematics at the start 
of the year, the more likely using PIA in the 
classroom will be effective as a medium of 
in-service training for PIA content. The same 
thing is not indicated, however, for learning 
basic mathematics not specifically in the PIA 
material . 

Although there were gains by both exper- 
imental and control groups from basic mathe- 
matics pretest to posttest, the gain of the 
experimental group was estimated to be only 
about 40% of that of the target population— 

.79 as compared to 2.00 points, out of a total 
test score of 20 (see Table 6) . Since the stan- 
dard error of the difference was . 39 , this dif- 
ference of 1.21 points is statistically signi- 
ficant. This coincides, as it must, with the 
finding from the ANOVA reported earlier. 

The analysis of covariance of post-exper- 
imental attitude, using pre-experimental atti- 
tudes as covariates, produced the same results 
as did the analyses of variance; i.e. , no ap- 
parent differences between experimental and 
control groups (see Table 7). Additional analy- 
ses of covariance of enjoyment and confidence 
"gain" scores, using basic mathematics pre- 
test scores as covariates, indicated that 
there were gains in both enjoyment and con- 
fidence over the school year (in the latter, 
particularly for teachers whose initial basic 
mathematics scores were high), but that there 
were no significant differences between exper- 
imental and control groups. 



Table 4 

Determination of Covariate Set for Analysis of Covariance: Knowledge 
(Estimated Error Variance with Various Covariate Groups) 
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Table S 

Analysis of Covariance: Knowledge 






! 



M 

& 

8 

CO 

w w 

£ | 

8S- 

CO w 

M <£ 
« M 

JS o 

w 2 

5 < 
°* 6 
o o 

a £ 

0 « 

CO U 

1 

•d* W 

2 to 

6 CO 

*— *s *>— S 

-4 CM 



tn 

0) 

1 



I 

§ 

c 

8 

8 



e e 
5 5 
tJ 5 

5 I 

Q <4-4 



fil 



S 

S 

o 

•H 

w 

ID 

CO 



3 

W 

0) 

o: 



3 

W 

& 

to 

<0 

•H 

!3 

35 

c 

£> 



c/3 

a 



o 

& 

CO 

£$ 

CL 



Qj 






C/3 

2 



19A91 

90U90]JfU6jS 

9;9?jreA^inw 



«l«9q;odXH JOj jp 



CO 

tv 



* * 

H H 

I o o 

I O O O’) 



10 0 ) 0 ) 
CO CO ^ 



IO lO o 

IO CM 



I/) GO LO 
tv H CO 
LO LO LO 
t ON 
• • • 
00 CM i-4 
LO CM 
w-» CO 



« « 

»-4 

o o 
© o a% 



H H N 

(O in O) 

• e • 

rs ^ cm 

-4 CO 



00 i-4 O) 
S N CO 
CM LO 
LO LO i-4 

i • « 

VO i-4 LO 
CO tv 



* * 

*-4 i-4 

o o 

O O 00 

o o o 

• 9 • 



N CM h H 
tv 



0> 

.C 

5 

4= 

§ 



CO CO CM 
ON s 



o in in 

CM ^ ^ 



CO H o 



S H S 

M 1 M 1 O 
s h in 

^■4 IN i—4 



CM 

00 

LO 

LO 



00 CO »-4 CM 



* 

LO 

in mp 

tv o .-4 
• • • 



O H 00 

f N 00 



O h 



tv oo vo 
<j) M 1 co in 
CM CO O) tv 
oo oo o 

• • • i 

O 00 CO CM 



* « 

CO H N 
O O CO 



tv CO i-4 CO 



CO 

IO 



s 

w to 

z* 9 9 

<0 ** u 

ll? 





i 

N 



t) 

9 

a 

0) 

c 

5 

t> 

S 

9 

*-* 

s 

0) 

£ 

CO 

X 



* « 



s 9 
1 5 



14 



o 

ERIC 



20 



l 

I 

(' 

t 

I 



\ 

! 

i 



1 



I 

( 



! 

f 



i 

i 



J 



12 




Fig. 2. Regression of PIA-specific posttest scores on basic 
mathematics pretest scores. 




Fig. 3. Regression of basic mathematics posttest scores 
on basic mathematics pretest scores. 





15 











< 


W 


01 


00 


** 


CO 


o 


o 


in 


01 


tv CM 


*r 


o 


in 


CO 


01 










t— ( 
ft 


• 


M 


00 


Ol 




in 


oi 


in 


in in 


in in 


in 


in 


in 


m 


*r 










M>4 


CO 




• 


• 


• 


• 


• 


• 


• • 


• • 


• 


• 


• 


• 


A 










<W 


O 




































li 




c 


in 


in 


CM 


CO 




rH 


co 


mt cm 


oi 


o 


rM 


rM 


00 








rH 


3 a 


*o 


id 


CO 


in 


O 




in 


CO 


01 rM 


MT CM 


CO 


rM 


o 


in 


CM 










id 


Ji 


Q) 


• 


• 


• 


• 


■ 


• 


• • 


■ « 


« 


• 


t 


■ 


A 








01 

■M 

•-M 

CO 


a 

0 


01 

M 


s 


o 


Ol 


o 

CM 




CM 


CM 


in 


00 00 


00 


13 


CM 


03 


00 








fl 

£ 


a 

<M 

01 

O' 


W 


• 

<M 

01 








o 


o 


in 




tv CM 


CO 


o 


*r 


CO 


01 








a: 


i 


M 








in 


01 


in 




in in 


in 


in 


in 


in 


<sr 










« a 


CO 


MM 

o 








• 


• 


• 




• • 


• 


• 


t 


A 


A 










H a 








































43 




c 










in 


oi 




in cm 


00 


00 


rM 


in 












,t3 


T3 


id 








o 




o 




rM in 


01 


rM 


rM 


CO 


tv 












4-» 


01 


to 


id 


id 


• 


• 


• 


a 

a 


• • 


• 


• 


• 


■ 


t 












01 

U 


2 








00 


i-M 

i-H 


rM 




00 00 


00 


CM 

rM 


rM 


00 


00 










ss 

ft 


• 

w 


• 

<M 

01 


CO 


Ol 


CM 


CO 


in 


o 


O CO 


rM in 


CO 


o 


o 


00 


CO 










• 


M 


Cl 


Ol 


00 


in 


0i 


in 


in 


tv in 


in 


in 


in 


in 


in 










wu 


CO 


Mm 


• 


<* 


• 


• 


• 


• 


• • 


• • 


• 


• 


• 


A 


A 










<M 


O 






H 
























< 






3 

C O 


































M 

n . i-h 






o x: 




c 


00 


CM 


rM 




in 


00 


00 CM 


mt in 


in 


in 


tv 


in 


rM 




* 0) 




<N 


•*4 4-* 

4J >H 


T3 


id 


00 


in 


in 


in 


00 


01 


in in 


in rM 




in 


in 


0i 


rM 




ti tj 






id t> 


4-t 


01 

*-< 


• 


• 


• 


% 


• 


• 


• • 


• • 


• 


• 


• 


A 


A 




2 o 




01 


rH p» 


01 


<J) 


<D 


O) 




o 




tv in 


tv tv 


00 


rM 




tv 


tv 




O *5H 1 

43 2 

a ^ u 


W 

H 

t—4 


a 

CO 


3 

a 

0 


M 


2 






«-H 














rM 










J 

o H 

t)2 I 

S « 

TO —4 1 

■M 1 


c 

id 

•e 


a 

til 


• 

W 


• 

•M 

01 








CM 


in 


00 




O Mr 


o 


tv 


in 


in 


CM 




CO 


01 

1 < 


, 


M 








in 


oi 


in 




tv in 


in 


in 


in 


in 


in 






£> 


CO 


MM 

o 








• 


• 


• 




• • 


• 


• 


• 


A 


A 




43 t0 

«M <M [ 






H eu 


































Tj CO 
* 01 
o o. 






43 

4-> 


7 


c 

id 








m 








in tv 


o 




CM 


o 


tv 










Z* 


01 








00 


in 


CM 




lO MT 


rM 


tv 


CO 


tv 


in 










01 


2 


to 


to 


id 


• 


• 


• 


a 

a 


• • 


• 


• 


• 


A 


A 




5 g 








U 








00 


01 


1 




tv tv 


01 


O 


1 


tv 


tv 




tJ -5 






























rM 










jO CO 








































7^ O' 








• 


4M 




























in 


oS . 
o- E 

+J 3 






< 


w 


01 


in 


00 


Ol 


in 


O 


V 


oi in 


rM 00 


01 


CO 


CO 


CO 


O 


,o 






a 


• 

CO 


M 

MM 

O 


• 


• 


00 

• 


CO 

• 


in 

• 


CO 

• 


CM CO 
• 


Mf CO 
• • 


CM 

• 


CO 

• 


CO 

• 


CO 

A 


CO 

A 


(T3 


01 01 






3 
































H 


gS 






II 
2 S 




c 


<j) 




m 


CM 


0> 


o 


in in 


00 01 


O 


CM 




CO 


in 




id 

H VI 

^ s 




H 

V 


*o 

+■* 

01 


id 

01 

2 

• 


• 

CM 


CM 

• 

f-M 


• 

CO 


CO 

• 

00 


« 


CO 

• 

CM 


tv Mf 
• • 
oo in 


0 o 
• • 

01 00 


CO 

« 

00 


• 

CO 


CO 

• 

CM 


tv 

A 

00 


00 

A 

tv 




£ * 
E 

01 .0 
In <M 




a 

CO 

c 


3 

a 

£ 


M 


H 


f-M 


CM 




rM 










rM 










V oi 

W 




id 

n 


% 


w 


■M 

01 








in 


01 


CO 




oi in 


rM 


^r 




CM 


O 






*s 


J7 SI 
<6 ^ 


• 


w 








CO 




CO 




CO CO 


CO 


CO 


CO 


CO 


CO 




£ g 
<o £ 




£> 


CO 


MM 

o 








• 


• 


« 




• • 


• 


• 


• 


A 


A 




fa | 






H 43 


































£ E 






a 




c 








CO 


00 


01 




oi oi 


in 


0i 




tv 


CM 




cr 








T3 


id 








m 


CM 


o 




tv CO 


oi 








CO 




*o CO 








V» 


0) 


id 


id 


to 


• 


• 


• 


a 

a 


• • 


• 


• 


• 


A 


A 




2 *• 
* a 








01 

W 


2 








oi 


13 


rH 




00 00 


00 


CM 

rM 


rH 


OO 


00 



M 



■m hJ 
V) 

W 



X* 

tO 

• H 

I 



t n 
0) 
n 

«S 

£ 

a 

O 



Cfl w 

e e 

0) V 

£ a 

o o 

CM CO 

JL JL 

*w < ’w 

a e 

3 0) 

<0 £ 

e Z 

0) w 
43 0) 

<M -M 

31 

Si> 



<° x i 
es * i 



r* CM 
Q1 +-» 4-i 

W w W 
.H 1 «M Q) d) 
^ M “ * 

ll“" 



in 

I 



O 

H 



w 

£ 

0) 



E ? 



12 13 
I £ 

U 0) 

a 5 

*3 fo 

a Ja 

g cn u 

<D I »*M 

£j <• W 
^3(0 

OT Ou CO 



n 

U 

•H 

•M 

<0 

£ 

0) 

43 

13 

2 

u 

0) 

(d 

00 



£ 



o c 

•*m 



£ 



5 

(0 

O 



o 

0) 

•n 

3 

3 

a 



(0 

e 

CO) 

O £ U 

C c 

0) £ 

IS 

p* .0 ^ 

Us 

£ 



01 

V 

•J 



01 

A 

(0 

ff 

0 01 
g s § 
III 

SI 3 

Cu 



■s 

§ 



«« 
a s 



01 u 
O' 01 
V CL 

$ w 

1 i 
2E 



£ 3 

W w 

01 *C 

s * 

3 2 

£ o 

« *35 

to 

CO 

2s 

a c 

01 Tj 
<0 * 
00 U 



*0 E o 
O 01 
S3 43 

S3 *» 



.§ 

rO 

c 

c 

5 

01 

01 

3 

r 

4J 

01 IM 

£ 



'I 

~ o 

5 c 

01 fli 

is 

a S I 

*! w o 
3 



16 



o 

ERLC 



22 



Table 6 (Continued) 
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For notes, see next page 



Populations "with PIk" but before PIA was used in the classroom are identical to populations "without PIA" because of random assignment 
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Dependent Variables: (1) Enjoyment of Teaching Mathematics 

(2) Confidence in Teaching Mathematics 
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Perhaps the best way to summarise Is to 
answer the questions posed as the goals of 
the study (see Figure 4): 



1 . Do teachers who use PIA increase 
their knowledge of modern mathematics; i.e. , 
is PIA an effective in-service course? 



The answer is a clear ves. provided we 
restrict ourselves to the general basic 
mathematics related to the PIA telecasts . 
However, if we look at content not speci- 
fically found in PIA, the answer is JJ2» 
for the gain scores for non-PIA-speclflc 
content, while definitely positive for 
both groups, were generally higher for 
the teachers who did not use PIA. It 
seems that while PIA teachers were gain- 
ing in knowledge of PIA content, other 
teachers made higher gains elsewhere than 
did the PIA teachers . 



2. Do teachers who use PIA become more 
positively disposed toftard teaching mathema- 
tics; i.e., enjoy it more or become more con- 
fident ? 

Both groups seemed to make slight gains 
in enjoyment and larger gains in confidence 
over the school year, but PIA teachers did 
not show an advantage over control teach- 
ers in this respect. 



3 a. Does the effect of PIA on teachers' 
knowledge vary with the demographic charac- 
teristics of the school? 




Fig. 4. Performance levels on knowledge 
and attitude variables for target 
population with and without PIA: 
Estimated means . 
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Whereas there was a difference in level 
of knowledge at the end of the study be- 
tween teachers in the two urban sites , 
this difference was not related to use of 
PIA. PIA was equally effective in both 
of these urban sites, as outlined in the 
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answer to question 1 above. Nor was 
any difference found between urban and i 
rural sites; PIA is equally effective as 
a medium of in-service education in both 
situations . 
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3 b. Does the effect of PIA on teachers' 
knowledge vary with the grade level taught? 

The answer appears to be no. 

3 c. Does the effect of PIA on teachers' 
knowledge vary with the level of teachers' 
Initial general knowledge of basic mathema- 
tics? 

Here, the answer Is a tentative yes ; PIA 
Is very effective as an ln-servlce tool 
for those whose Initial level of basic 
mathematics Is low to average; for those 
whose pretest scores fall more than a 
standard deviation above the mean, the 



effect Is lessened. 

4. Does the effect of PIA on teachers' 
attitudes vary with these same three factors ? 

The demographic chracterlstlcs of the 
school seem to make no difference) nor 
does the grade level taught. Whereas 
there was a slight increase In teachers' 
enjoyment no matter what their Initial 
level of knowledge, those who scored 
high on the basic mathematics pretest 
seemed to have greater gains In confi- 
dence than those whose Initial scores 
were lower; however, this occurred re- 
gardless of whether PIA was used. 
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Appendix A 

Overview of the Key Mathematical Ideal in 
Patterns in Arithmetic, Grades 1-6 
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The following is a brief description of the fundamental concepts which run 

through the Patterns in Arithmetic series. 

1. Set: The concept of a set is fundamental for developing and communicating 
ideas in mathematics. Since the idea of a set is a rather primitive one, as 
early as Grade 1, pupils become familiar with the simple concepts which 
involve sets, such as setting up a one-to-one correspondence (matching) 
between sets and comparing the numerousness of two sets. The set idea is 
found to be particularly useful in the teaching of addition (set union) and 
subtraction (set complementation). Set ideas are also applied in the later 
grades to equivalent fractions, equivalent ratios, and geometric figures. 

2. Number : One of the main features of the program is the logical develop- 
ment of the rational numbers, beginning with the positive integers. Near 
the beginning of Grade 3 the pupils will be able to determine the cardinality 
of any set with less than 10,000 members and to use the ordinal numbers. 
During the First, and again the Second Grade, the pupil is taught the ideas 
of between ness , less than , greater than , and equal to for numbers less than 
1,000. The number line is used to picture the order of integers and the 
pupil is taught how to use this line to perform addition and subtraction. 

These ideas are reinforced and extended so that near the end of Grade 6 
the pupil is totally familiar with the positive rational numbers. Other mis- 
cellaneous topics covered in the series are even and odd numbers, prime 
numbers, prime factorization of natural numbers, the least common multiple 
and greatest common factor of pairs of natural numbers, and the negative 
integers . 

3. Numeration System: After some degree of understanding has been achieved 
in counting with both cardinal and ordinal numbers, the pupils are taught 
how to write the numbers 0—9, and after 9, the concept of place value is 
introduced. Although the pupils do not fully comprehend place value at this 
time, extensive use of tally charts and regrouping is introduced in order to 
overcome some of the mystery of place value. Near the beginning of Grade 4 
the pupil should be able to write all numerals and interpret place value for 
larger numbers. Although emphasis is on the decimal system (Base 10), nu- 
meration systems with other bases (Base 5, Base 2) are introduced to pro- 



mote understanding of place value. Positive rational numbers and the sev- 
eral notations associated with them (common fraction, mixed number, deci- 
mal fraction) are introduced in Grades 4—6. 

4. Op erations : A considerable portion of elementary school arithmetic is con- 
cerned with the four fundamental operations: addition, subtraction, multi- 
plication, and division; and how these operations act with various sets of 
numbers (natural numbers, positive ratlonals, Integers). Of course, one of 
the major objectives of any elementary school arithmetic program is to de- 
velop accuracy and speed in computing. However, computing in Itself is 
not enough; therefore, we have placed considerable emphasis on ideas 
associated with computing in an attempt to make the four operations more 
than rote calculation. For example, in forming the sum 3 + 2, the pupil con- 
siders a stationary set with 3 objects and another set of 2 objects which 
appear to be joining the given 3. Thus 3 + 2 is looked upon as a set of 3 
being Joined by a set of 2 to form a set of 5. The concept of column addi- 
tion is approached through tally charts in an attempt to Impart some under- 
standing of place value in our Base 10 numeration system. Rectangular 
arrays are used to analyze geometrically the operation of multiplication. 
Geometric arguments are made to lend substance to the operations applied 
to the positive rationals. The notion of operation is extended in Grades 5 
and 6 by Introduction of an operation with a simple geometric realization. 

Beginning in the First Grade the commutative, associative, and dis- 
tributive properties of the operations receive considerable attention as aids 
to computation. Not until Grade 5 are the properties formalized for the 
pupils. Upon completion of Grade 6 the pupil will be able to compute ef- 
ficiently with the positive rational numbers in their many notations. 

Throughout PIA the pupils are presented verbal situations in which they 
can apply their newly acquired computational skills. In these situations 
special attention is devoted to developing the ability to formulate mathe- 
matical sentences in a clear and natural way. 

5. Mathematical Sentence (Equation): Since language is the vehicle through 
which we communicate our ideas, it is Important that pupils begin to develop 
the ability to generate mathematical sentences as soon as possible. In the 
First Grade, the pupil encounters many experiences with pictures and objects 
which lead to basic sentence forms. In word problems pupils are requested 
to "write a sentence which tells the story of the problem" before finding the 
solution. (Problem: A box holds 6 apples. How many boxes are needed for 
30 apples? Sentence: N x 6 * 30.) Throughout the series the same im- 
portance is attached to the need to translate verbal problems into mathe- 
matical sentences. 
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Measurement; Owing to its importance in everyday life as a key link be- 
tween our physical and social environment, we begin a systematic study of 
measurement in the First Grade. As an introduction, the First Grade pupil 
becomes familiar with the concept of relative length (the desk is less than 
five pencil-lengths long) and a non-standard unit of measurement (the pen- 
cil above). Upon completing the first four grades, the pupil will ba able to 
carry out approximate linear measurements in standard units (inches, feet) 
and he will be able to find the perimeter of some elementary geometrical 
forms (triangle, rectangle). In Grades 5 and 6 the concepts of area and 
volume are discussed in terms of non-standard and standard units of mea- 
sure and approximation techniques are used to estimate areas and volumes 
of irregular regions. Formulas for areas or volumes of elementary regions, 
such as a rectangular region and right rectangular prisms, are introduced. 

Geometry : One of the more unique features of the program is a systematic 
development of elementary geometrical concepts beginning in the First 
Grade. Aside from learning the names of the more common geometrical 
figures, the pupil becomes familiar with open and closed curves, interior 
and exterior of geometrical forms, points, lines and angles, intersection of 
curves, parallelism, and perpendicularity. The notions of congruence and 
similarity are introduced intuitively in the early grades and in the later 
grades approached from transformations in the plane (reflections and dila- 
tions). 

Practical Aspects: Although the practical aspects should not perhaps be 
mentioned as a fundamental strand, these aspects are important enough in 
the daily activities of pupils to warrant special attention. Beginning in the 
primary grades the pupil is exposed to aspects of linear and cubic (cup, 
pint, etc.) measurement. By the end of Grade 4 the pupil will have some 
experience in measuring the boundary and area of plane geometrical forms. 
Other practical aspects covered in the first three grades are money and 
making change and use of the thermometer. 
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TEACHER INFORMATION QUESTIONNAIRE 



(Do not mark in 
this space) 
School Code 



1. School: ■ 2. City: 

3. Your age: 4. Sex: M F 

5. How many years have you taught? (Include this year but not 
practice or Intern teaching.) ^ 

6. What grade do you teach? (check one) First 

Second 

Third 

Fourth 

I do not teach one grade, but am an arithmetic/ 
mathematics spec tail* t in several grades. 

7. How many years have you taught this grade or in this capacity? 

8. Prior to this school year, have you ever used a televised 

arlthmetlc/mathaaatlcs program at least* once a week in your 
classroom? Yes 

No 

9. Number of semesters of mathematics courses taken in high 
school: 

10. Number of semesters of mathematics courses taken in college 
(undergraduate or graduate) : 

Mathematics for elementary school teachers 

College algebra 

Other (e.g. trigonometry, calculus, beyond calculus) 



11. Number of semesters of mathematics education courses taken 
(undergraduate or graduate) : 

Methods of teaching arlthmetlc/mathmiatlcs 

Seminars in mathematics education in elementary schools 



33 



30 



w 



> 



12. When did you complete the following (give year 
for ell which apply) 



High School 19 
Bachelor' e 19 
Master's 19 
Doctorate 19 






13. Have you received college credit for couree work taken 
elnce your laet degree? 

If f, yee": 

How many credlte or polnte 

In what year did you. laet receive euch credit? 



Yea 

No 



19 



14. Have you ever attended a National Science Foundation 
or other Institute In modern mathematics? 

If "yes": 



Yes 

No 



How many college credits did you receive for the 
institute? 



In what year did you last attend such «n Institute? 19 
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IS. Have you ever attended an inaervice course in modern Yes 

arithmetic or mathematics sponsored by your school or 

school system? No 

If "yes": 

In what year did you complete the inservice course(s)? 19 

Approximately hov many hours were spent in the 
inaervice course(s) (check one) : 

1-4 hr 5-9 h r 10-19 h r 20-40 h r more than 40 hr . 



16. Compared to the other aubjects you teach, hov do you enjoy teaching 
arithmetic? (check one) 

more than better moderately less than least 

any other than most veil. most of all 



17 « When teaching the more difficult concepts of arithmetic, hov confident 
do you feel about your knovledge of those concepts? 

completely quite somsvhat not very 

confident confident confident confident 
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Appendix C 

Post-Questionnaire — Mey, 1971 
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TEACHER QUESTIONNAIRE 



(Do not mark in 
this space) 
Teacher Code 



1 . Name s 

2. School: 3* City: 

4. What grade do you teach? (check one) Firet 

Second 

Third 

Fourth 

I do not teach one grade, but am an arithmetic/ 
mathematics specialist in several grades, 

5. Have you taught the class you are now teaching for this entire school Yes No 

year? If no, please explain: 



6. Compared to the other subjecte you teach, how do you enjoy teaching arithmetic? 
(check one) 

more than better moderately less than least 

any other than most well most of all 



7* When teaching the more difficult concepts of arithmetic, how confident do you feel 
about your knowledge of those concepts? (check one) 

completely quite somewhat not very 

confident confident confident confident 



8. How many Patterns in Arithmetic telecasts did your class view this year? (check one) 

ell (except for those shown most about half a few none 

during vacation periods) 



9. How many pages in the PIA student exercise book did your class complete? (check one) 
all most about half a few none 




PIA school teachers: go on to page 2, question #10. 

Control school teachers: skip to page 5, explanation of teatt 
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10* Did you learn any new Instructional methods from the Patterns In Arithmetic 

series? many 

some 

none 

11. Did you learn any new mathematics concepts from the PIA series? many 



none 

12 • For how many lessons did you rsad the Mathematical Background section of your 
PIA teacher's manual? til 

most 

about half 

a few 

none 

13. Now that you have had the experience of teaching with PIA for one year, how do 
you think things would go If you used the program again next year? (Check the 
response which comes closest to how you feel*) 

This year went well, but next year would be even better 

This year went well, and next year would be about the same 

This year did not go too well, but next year would definitely be better 

This year did not go too well, and next year would be about the same 

14* How do you feel about the effect PIA this year has had on your pupils' under- 
standing of arithmetic? 

Better than other classroom methods 

Positive, but not necessarily better than other methods 
Negative or no effect 

(I have no basis to judge since this was my first year teaching) 

15. Was It possible for you to individualize Instruction using the PIA series? 

all of the time 
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much of; the time 
some of the time 
never or rarely 



■w 



16. Was Pa (tarns in Arithmetic your smjor (basic) arlthMtlc 
program or a aupplsmantal program this year? (chack ona) 



major program 

Aupplsmantal program 

1 used PIA raraly or not at all 



17. If PIA wara aval labia to you next yaar, how would you 
use itt (chack ons) 

major program 



aupplsmantal program 
I would uae it raraly or not at all 



Directions : Plaaaa rata each aspect of PIA listed balow by 
placing a check in ona apace . 
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Value of the Patterns in Arithmetic teacher's manual 

J 



useleaa 



J 



Value of the pupil exercise books 
useless | | II 


i i 


Value of the telecasts for students 
useless I I j I 


i i 






> 
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useful 



useful 



useful 



J 






Attitude of etudente toward teleceste 
diaintereetad 1 1 1 1 


| interested 


Quality of tha TV Teacher 'a presentations 
poor | J I I 


j good 


Pacing of tha TV Teacher's presentation 
too fast | 1 1 | 


| | too slow 


just right 




Tine interval between telecasts 
too short 1 III 


| | too long 


just right 




Lsval of difficulty of PZA for your class 
too hard 1 1 1 1 


| | too aaay 


Just right 




Your attitude toward PZA at tha beginning of 


tha school year 



negative | 1 | | | poeitive 



Your attitude toward PIA now 




negative | L 1 1 


| poaitive 



QfO SI7.7S4-4 





37 



Appendix D 

Pretest— September, 1970 



Note: Questions with an asterisk also appeared on the posttest. 



0 




. s * 
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* 

1. Which of the following number sentences are equivalent 
to the sentence whose model is shown on this number line? 

I 7 . J 






0 


1 


t 


3 


4 8 


— - 

• 


7. 


(a) 


N - 


7 + 5 






(c) 


N + 5 


- 7 


<b) 


N - 


7 - 5 






(d) 


7 - N 


-5 


A. 


Only 


(a) 


and 


<bj 


D. 


Only 


(b), (c) and (d) 


B. 


Only 


<1>) 






E. 


All of these. 


C. 


Only 


<b) 


and 


(c) 









2* If x and y are positive even integers and if p and q 
are positive odd integers, which of the . following is 
FALSE? 

A. x + y is a positive even integer 

B. p + q is a positive* odd integer . 

C. xy is a positive even integer 

D. pq is a. positive odd integer 

E. px is a positive even integer 



3. Which of the following are true? 



(a) 


3 v 

7* 


!-* 




(b) 


18 

35 


is the reciprocal of 




(o) 


4 ' 

5 X 






(d) 


0 V 

7 x 






A. 


Only 


(a) 


D. Only (c) and 


B. 


Only 


(») 


E. All of these. 


0. 


Only 


(a) and (b) 
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4. In what base are the numerals written if 2x2* 10? 



A. Base four 

B. Base three . 

C . Base two 



D*. Base five 
E. None of the above 
is correct. 




5. The equality of the arrays above illustrates which of 
the following properties? 

A. CooMtatlve property of addition 

B. Cosnutatlve property of sMltiplicatlon 

C. Associative property of addition 

D. Associative property of sailtipllcatlon 

E. Distributive property of SMltiplicatlon with 

respect to addition 



6. Qiven ZRST as the unit angle 



C 




The sum of the measures of the angles of A ABC in 
terms of the unit angle is: 



A. 


0 


units 


D. 


180 


units 


1*. 


7 


units 


E. 


None 


of theso. 


C. 


5 


units 









7. A ball club won 4 of the 8 games already played. 
If it wins the next two games, what percent of the 
games will it then have won? 

A. 80 D. 50 

B. 70 E. 60 

C. 75 

r.3> 
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B. Which of the following represents the same number as 
(6 x 10 4 ) + (6 x 10 2 ) + (6 x 10 1 )? 

A. 6,066 

B. 6,660 

C. 60,066 

D. 60,660 

E. 66,600 



Questions 9 and 10 refer to the addition exercise below: 

, 672 » 6 hundreds + 7 tens + 2 ones 

Q3» » 8 hundreds + P tens + 4 ones 

Q hundreds + ]0 tens + 6 ones 

» R thousands + S hundreds + T tens + U ones 

** R, S T U (Pinal answer) 

9 * P - 

A. 8 D. 34 

B. 3 E. 834 

C. 83 




10. In the final answer, R, S T U represents: 

A. The product of the numbers R,S, T and U. 

B. The sum of the numbers R, S, T and U. 

C. (R X 1000) + (S X 100) + (T X 10) + (U X 1). 

D. (R X 1) + (8 X 10) + (T X 100) + (U X 1000). 

E. Eleven thousand, five hundred six. 

11. * In order to find the product (> x 9 we might: 

A. Form the union of two disjoint sets with six and 
nine members. 

D. Form a six by nine array, 

C. Use the division algorithm. 

D. Notlc. th»t (6 * 9) btM w - 3 ten x <6 thr „ x 9 three ). 

E. Draw a triangle with aidea 6" and 9" long. 
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12. Which of the following sets of points best represent 
the inequality 2 < n < 7 where n is a whole num- 
ber? 



A . < ■ - - —* *— * — * — * » * • - - > . 

0123 * 56789 ' 



B. — - > 

876543210 



C. <♦-•'« • p • a • — * > 

15 16 17 18 19 20 21 22 23 

D. < — » ■» < * « e t ♦ e - - > 

23 4 56789 10 



E . < — • — • — • * — « — * — * — 

0 123456789 



5 

_4 

20 



13* Which of the following checks of Che computation above 
makes direct use of the commutative property? 




4 

B. 5 JET 
20 
0 



5 

5 

20 



D. 4 E. 4 

* 

4 20 

4 
j 4 
20 



4 x 376 - (4 x 300) + □+ (4 x 6) 
14.* What number goes in place of Q above? 

A. 12 

B. 24 

C. 28 

D. 240 

E. 280 



IS* Which of the points A, B, C, D, or E on this num 
ber line can be named by the fraction £ ? 



16 . 6l20 nlne 1° how many times as large as 6lC nlne ? 



A. 


twelve 


D. 


five 


B. 


ten 


E. 


None of the above Is 


C. 


nine 




correct. 



17. Indicate which English sentence or sentences cprres- 
pond to the open sentence, K < 13. 

(a) The temperature Is below thirteen degrees. 

(b) Joan bought* more than thirteen pairs of shoes. 

(c) There are fewer than 13 books overdue. 

(d) Bill has thirteen dollars. 

A. Only (a) and (c) 0. Only (b), (c) and (d) 

B. Only (c) and (d) E. All of them. 

C. Only (a), (b), and (c) 



18. Which of the following angles appear to be congruent 
to ZABC ? 





Only 


ZD and 


Z P 


D. Only ZD, ZE, and ZQ 


Only 


ZE and 


ZH 


E. None of these. 


Only 


ZD and 


ZQ 






! 
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19. Which of the following ane models for tne same rational 
number as this one? 





A. Only (a) D. Only (a), (b) and (d) 

B. Only (c) / E. All of these 

C. Only (a)' and (b) 




B. 2x3x5 

C. 2 x 3 x 3 x 3 x 5 

D. 2 x 3 x 3 x 3 x 3 X 3 x 3 x 3 x 5 

E. None of the above. 



O 
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Tom 



Mary 



Dick 



7 




22. The algorisms above by different pupils are based on 
Interpreting division as successive subtraction. 



the step completed by the pupils? 

A. All are wrong 

B. Only Mary is right 

C. Only Tom and Mary are right 

D. All are right, but Dick's technique Is the most 

efficient 

E. All are right, but Mary's technique Is the most 

efficient 



23 . Four of the following numerals are names for the same 
number. Which one names a different number? 



24. What la the hundreds digit In the answer to 
3375.49 - 861 . 1 ? 



25. What Is the number of different prime factors of 60? 



Which of the following statements can be made about 




D. 

E. 25 thousandths 




A. 5 

B. 2 

C. 4 



D. 1 

E. 9 



A. 0 

B. 1 

C. 2 



D. 3 

E. 4 
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26 . Choose the test way to complete this statement: Standard 

units of measurement are used because 

A. it is important for people to use the same unit in 
dealing with each other. 

B. standard units give more accurate measurements than 
units which are not standard. 

C. people have always used them. 

D. they are all related to base 10 numeration. 

E. the English system is more natural than the metric 
system. 



27 . Which of the following are models for the same rational 
number as this one? 



mu 


! — ! 








A. Only (a) and (b) 

B. Only (a) 

C. Only (d) 




D. Only (a), (b) and (c) 

E. All of these. 



3 



• 27 
12 
15 

_JQ 

9 



4 

k 



-21 

0l9 



28* if the algorism above is based on interpreting division 
as successive subtraction then k * 



A. 2 

B. 3 

C. 5 

D. 6 

E. 9 
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29. Which or the following are empty sets? 

(a) All odd numbers exactly divisible by 2. 

(b) Women who have been president of the U.S.A. 

(c) All positive even numbers exactly divisible by 5. 

(d) All whole numbers which do not have 1 as a factor. 

A. Only (b) 0. Only (a) , (b) and (d) 

B. Only (a) and (b) e. All of these. 

C. Only (b) and (c) 



30. 



Consider the set { p, q, r, s, t) and the operation 4 between 
two members of this set. The following is a table for 4 
on this set. 



4 


p 


q 


r 


8 


t 


P 


p 


p 


p 


p 


p 


q 


p 


q 


r 


8 


t 


r 


? 


r 


t 


q 


8 


8 


p 


8 


q 


t 


r 


t 


p 


t 


8 


r 


q 



Which of the following statements is true? 

I. r 4 s ■ s 4 r 
II. r 4 (t 4 s) - (r 4 0 4 s 
III. p is the Identity for 4 

A. I only 

B. II only 

C. Ill only 

D. I and II only 

E. I, IT, and III 







Suppose 



is a binary operat ion with 



1 I 1-0 

2 _L 2 - 3 
5 _L. 6-29 

What is 6 I 3 ? 

A. 6 

B. 3 

C. 9 




D. 17 

E. 18 
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4 J2 

x 2 

4 

60 

800 

864 

J2. Thu buttle propurty usud in the algorism above is 
illuHtrutud by which o£ the following? 

A. x(yz) ■ (xy)z 

B. x + (y + z) - (x + y) + z 

C. x(y + z) ■ xy + xz 

D. x + y+ z- z + y + x 

E. xyz “ zyx 

33. The most important common property of the sets (A, 2,* ) 
and (0, 1,2) Is suggested by 

D. empty 

E. 3 



34 * Which of the following number- line diagrams 

illustrates the subtraction operations depicted 
in the division algorism above? 



A. 

B. 

C. 



2 

(,,) 

6 



3 \xi I 



3 

9 

6 

3 

3. 

0 



A. 



0123456789 10 11 12 




0 1 2 3 4 5 6 7 8 9 10 11 12 




0 1 2 3 4 5 6 7 8 ,9 10 11 12 

so 50 




! 

\ 

f 

j 

! 

i 




35* 


The 


Inverse operation for addition is: 




A. 


addition. 


D. division 




B. 


subtraction. 


£. None of these. 




C. 


multiplication. 






What, !;; I, he mini ol* ulil; 


8,,<J 3 ol(5ht 7 




A. 


^elght 


D ‘ U elght 




B. 


l8 elght 


E. None of these. 




C. 


10 eight 





12 + 3-4 

37. If the division above la Interpreted aa finding 
how many groupa of 3 each make up 12, which of the 
following operations la moat nearly analogous to 
this? 

A. Finding the size of a hand of cards If you 
know the size of the deck and the number of 
hands 

B. Finding the area of a lot if a tract of land 
of . known area la subdivided Into a given 
number of equal lota 

C. Finding the number of feet in a 48- inch length 
with a 12 -inch ruler 

D. Dividing a pie equally among a given number 
of people 

E. Finding what number can be subtracted four 
times from 12 



38. A point P lies 4.03 Inches from the center of a circle, 
with a radius of 4.3 Inches. Which of the following 
la true? 

A. P lies outside the circle 

B. P lies at the center 

C. P lies Inside the circle, but not at the center 

D. P lies somewhere on the circumference 

E. It cannot be determined whether P lies Inside, 

on, or outside the circle 
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39. Which of the following is the best example of something 
unique? 

A . a symbol for the number of fingers you have 

B. the second house from a certain corner in a 
residential district 

C . the number of eggs in a dozen 

D. a point on a ruler which is one inch from the 
three -inch mark 

E. a rectangle with one side five inches long. 



40* If r < 0, s > p, s < q, and 0 < p, which of the 
following number lines shows the correct relative 
positions of p, q, r, and s? 



0 



B. 4 
C- 4 

D. 4 

E. 4 




41. If 13 candy bars are to be given to 3 boys so that 
each boy received at least one candy bar, which of the 
following statements must be true? 

A. One boy receives 10 candy bars. 

B. Each boy receives at least 2 candy bars. 

C. One boy receives at least 5 candy bars. 

D. One boy receives at least 7 candy bars. 

E. The boys all receive a different number of candy 
bars . 
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42. If X * (b, a) and Y » (7»0)» the most important 
property of the set XUY is suggested by 

A. ( ) D. the order b , a , 7* 8 

B. 7 E. 2 

C. 4 

43. * If x, y, z are numerals In base five notation, which 

of the following are correct? 

(a) x + y « y + x 

(b) x(y +z) =* x.y + x.z 

(c) if x < y and y < z then x < z: 

A. Only (a) D. Only (a) and (c) 

B. Only (b) E. (a), (b), and (c) 

C. Only (a) and (b) 



44. Which of the following are true? 
/x 2 4 8 10 'll 



(b) |+ £ - x? 

(e) ^r + ^r-7l 

<-) t+M! 



A. Only (a) 

B. Only (a) and (b) 

C. Only (c) and (d) 



D. Only (a), '(b) and (c) 

E. All of them. 




If A and B are two sets which can be matched (put 
in 1 to 1 correspondence) then: 

A. A and B must both be sets of numbers. 

B. A and B must have the same number of elements. 

C. Neither A nor B can be the empty set. 

D. A and B must both be sets of points. 

E. A and B must each have one member. 
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46.* Which of the following it the multiplicative inverae 
of 4.0? 

A. 0.04 

B. 0.25 

C. 0.4 

D. 0.5 

E. 1.25 



47.* Which one of the following division examples will result 
in the quotient, 25.2 ? 



A. 5) 7155 

B. .5) 7T25 

c. .05F . 12 b 



D. .005) ".W 

E. .0005)" .125 



48* A football team starts the following series of plays 
from its own 20-yard line: gains 8 yards, loses 2 

yards, loses 1 yard, gains 6 yards. On what yard 
line is the ball now? 



A. 


11 


B. 


26 


C. 


31 


D. 


34 


E. 


37 




49. Which of the following intersection sets is impossible 
for a straight line and a triangle? 

A. The empty set 

B. A set of exactly one point 

C. A set of exactly two points 

D. A set of exactly three points 

E. A Bet of an infinite number of points. 

54 
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50. The equality 2 x (3 + 4) ■ 2 + (3x4) is an 
illustration of which of the following 
principles? 

A. The associative law of addition 

B. The conmutatlve law of addition 

C. The distributive law of multiplication 

with respect to .addition 

D. The commutative lav of multiplication 

E. None of these 



ERIC 




55 



Appendix E 
Posttests — May, 1971 



Note: Questions 1-15 were, for the most part, different for 
each grade level. These appear in thi3 appendix as PIA-specific 
content, Grades 1, 2, 3, and 4. Questions 16-35 were the same 
for all grade levels, as they were culled from the common pretest. 
In the actual tests, there was no break between questions 15 and 
16. However, to avoid duplication, questions 16-35 appear only 
once in this appendix, under the label Basic Mathematics. 



EXPLANATION OF THE TEST 



This is a test on some o£ the basic mathematical concepts which underlie 
a modern arithmetic program. Many of these concepts have not, in the past, been 
stressed in the elementary school curriculum; consequently, some of the ideas 
in this test may be unfamiliar to many teachers. 

Results from this test will be compared with those from a similar test given 
last fall. If you did not take a test similar to this last fall, check here: 



DIRECTIONS 

All of the questions in this test are multiple choice. You are to select 
the one best answer from the five choices given and circle the letter of that 
answer choice. 

Here are two sample questions: 



The correct answer 18 D , since 8460 ■ 846 x 10. Therefore, the letter D 
would be circled: 



I did not take a 
test similar to 
this one last fall. 



□ 



EXAMPLE 0. 



Which of the following is a multiple of 10? 



A. 1 



D. 8460 



B. 5 



E. 77777 



C. 101 



A. 1 




8460 



B. 5 



E. 77777 



C. 101 
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EXAMPLE 00 



Which of these is another name for 27? 



(I) 2 x 10 + 7 



(XI) 3x3x3 



(III) 72 



A. .Only I 



D. Only I and III 



B. Only III 



E. I, II and III 



C. Only I and II 



Both 2 x 10 + 7 and 3x3x3 are equal to 27. Therefore the correct 
answer is M C. Only I and II,” and the letter C is circled. 



You may use any extra space for scratch work. Go ahead and begin. 



Selected items are reproduced by permission of Educational Testing Service, the 
copyright owner, Others are copyrighted by the Board of Trustees of the Leland 
Stanford Junior University, and are reproduced with author's permission. 
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PIA-speclflc content: Grade 1 
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1. Which of the points are on the same side of the curve? 



2 . 




place value? 

(I) 81 and 812 

A. only I 

B. only II 

C. only I and II 



(II) 4802 and 876 (III) 8 and 538 

D. only I and III 

E. only II and III 



3. Set A has nembers 2, 3, 4, 5, and 6. Which of the following numbers comprise 
a subset of A? 



A. 0, 1, 7, 8, 9 

B. 1, 2, 3, 4, 5 

C. 1. 2 



D. 2, 5 

E. 0, 1 



4. Which Is an example of changing something from a closed curve to an open 
curve? 



A. breaking a rubber band 

B. peeling a tangerine 

C. bending a hula hoop 



D, cutting a hole In a fish net 

E. snapping a rung In a 6-foot 
ladder 




II 



60 



5 



and set B 



If set A - |l, 2, 3^ 

A. equal 

B. equivalent but not equal 

C. disjoint 



I 3 , 2, 1}, 



then A and B are 

D. associative 

E. commutative 



60 Which point Is Inside the curve? 

A. A 

B. B 

C. C 

D. D 

E. none of these 




?. Which of these shows the meaning of Inverse operations? 

A. 3 - 3 - 0 D. (3 + 5) - 5 

B. 3 + 0- 3; 3-0-3 E. (3 + 5) + 0 

C. 3 + 5 - 5 + 3 



- 3 



3 + (5 + 0) 



8 . Which of these Is an example of the commutative property of addition? 

A. 6 + 0- 6 D. 2 + 6 - 3 + 5 

B. 2 + 2 - 2 x 2 E. 6 + (2 + 3) = (6 + 2) + 3 

C. 2 + 6 -6+2 



9. If a, b, c, d and e are whole numbers, and If a > d, b < c, e > c 
and a < b, which Is the largest number? 

A. a D. d 

B. b E. e 



! 
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10. Which of the following Is a simple closed curve: 



A. 



& 



D. 



B. 



C. 




E. 



12 . 



13. 



Which of the following Is exact? 


Finding out the number 


of 


A. 


pounds a boy weighs 


D. 


miles between 


two cities 


B. 


inches in a foot 


E. 


square Inches 
of this page 


In the area 


C. 


cups of water In a bowl 









X 7 9 

On the number line above, X 

A. 0 

B. 1 

C. 4 



D. 5 

E. not necessarily any of these 



l #t row 



2 nd 



row 




A child says that there are more circles when they are spread out (as In the 
second row above) than when they are close together. This most probably 
means he Is not yet able to 



A. 


conserve numerousness 


D, 


recognize when one stick Is 
shorter than another 


B. 


count from one to five 


E. 


say "five" when presented with 


C. 


memorize simple addition facts 




the numeral 5 
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14. If set A Is equivalent to set B and set B Is equivalent to set C, then 



(I) A and C are equivalent 

(II) A and C have the same members 

(III) A and C can be put Into one-to-one correspondence 



A. I only 


D. II and III only 


B. II only 


E. I, II and III 



C. I and III only 

15. Which number is associated with the empty set? 

A. -1 D. 10 

B. 0 

C. 1 



E. 



00 



PIA-specific content: Grade 2 
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1. 



o 
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On the number line above, X = 

A. 0 

B. 1 

C. 4' 



D. 5 

E. not necessarily any of these 



2. When performing the indicated subtraction, 



34 



34 


should be considered as 




- 18 










16 




A. 


20 tens, 4 ones 


D. 


2 tens, 14 ones 


B. 


20 tens, 14 ones 


E. 


3 tens, 14 ones 


C. 


30 tens, 4 ones 








Which of the following is exact? 


Finding 


out the number 


of 


A. 


pounds a boy weighs 


D. 


miles between 


two cities 


B. 


inches in a foot 


E. 


square inches 
of this page 


in the area 


C. 


cups of water in a bowl 









4. 



Which is an example of changing something from a closed curve to an open 
curve? 



A. breaking a rubber band 

B. peeling a tangerine 

C. bending a hula hoop 



D. cutting a hole in a fish net 



E. snapping a rung in a 6- foot 
ladder 



63 



V 



68 



i 

4 

i 



i 






;S 






% 






1 






5 . 




0 1 2 3 4 5 6 7 8 9 10 11 



This number line diagram shows which of the following situations? 

A. 4 + 5- 9 D. 9-4 - 5=0 

B. 9-4-5 E. 0 + 4 + 5- 9 

C. 9-5-4 



6. Which point is inside the curve? 

A. A 

B. B 

C. C 

D. D 

E. none of these 

7. How many members are in the solution set for n < 6 if the solution 
set is drawn from the set of positive odd numbers? 

A. 3 D. an infinite number 

B. 4 E. none of these 

C. 5 



c 




8. The shaded area of the polyhedron 



is called a 

A. prism 

B . pyramid 

C. edge 

D. face 

E. vertex 



O 
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69 



% Which of these would be solved using subtraction? 

A. n + 7 - 12 D. n - 12 = 7 

B. n - 7 * 12 E. none of these 

C. 12 + 7 = n 



10. In order for a pupil to decide which is the larger of 248 and 263, it 
is sufficient for him to compare the 



A. tens 

B. hundreds 

C. tens and ones 



D. hundreds and ones 

E. hundreds arid tens 



11. If a, b, c, d and e are whole numbers, and if a > d, b < c, e > c 
and a < b, which is the largest number? 



A. 

B. 

C. 



a 

b 

c 



D. 

E. 



d 

e 



12, Which of these shows the meaning of inverse operations? 



A. 3-3-0 

B. 3 + 0- 3; 3-0-3 

C. 3 + 5 - 5 + 3 



D. (3 + 5) - 5 

E. (3 + 5) + 0 



- 3 



3 + (5 + 0) 



13. 419 can be rewritten 



A. 


2 hundreds 


+ 


10 


tens 


+ 


9 


one 8 


B. 


2 hundreds 


+ 


20 


tens 


+ 


19 


one 8 


C. 


3 hundreds 


+ 


9 


tens 


+ 


19 


ones 


D. 


3 hundreds 


+ 


10 


tens 


+ 


9 


ones 


K. 


3 hundreds 


+ 


20 


tens 


+ 


19 


ones 
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14. Geometric figures which are the same size and shape are 



A. 


equal 


D. symmetric 


B. 


equivalent 


E. congruent 


C. 


proportional 





The 

the 


column which is shaded In 
table shows that 




0 


h 


2 


3 


4 


A. 


n + 0 « n 
n x 1 ■ n 


0 

1 


I 


, 


2 


3 


4 


B. 

C. 


1 


2 


3 


4 


5 


n x 0 ■ 0 


2 


1 


3 


4 


5 


6 


D. 


n * n ■ 1 


3 




4 


5 


6 


7 


E. 


n + r ■ r + n 


4 




5 


6 


7 


8 



*? 



i 



i 

I 

I 

i 

? 

I 

i 
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The equality of the arrays above Illustrates which of the following 
properties? 

A. Commutative property of addition 

B. Commutative property of multiplication 

C. Associative property of addition 

D. Associative property of multiplication 

E. Distributive property of multiplication with respect to addition 

2. Which of these number pairs (ratios) would NOT be used when converting 
between feet and yards? 




4. When performing the Indicated subtraction, 



34 



O 

ERIC 



34 


should be 


considered as 






-18 

16 


A. 


20 tens, 


4 ones 


D. 


2 


tens, 14 ones 


B. 


20 tens, 


14 ones 


E. 


3 


tens , 14 ones 


C. 


30 tens, 


4 ones 
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« 
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5. Which of these figures contains the largest angle? 

□ v A <? 

ABC D 

6. What is the name of the number property that links addition with multiplication? 



A. 


Associative 


D. 


Identity 


B. 


Commutative 


E. 


Inverse 


C. 


Distributive 







Which of the following is exact? 


Finding out 


the number of 


A. 


pounds a boy weighs 


D. 


miles between two cities 


B. 


Inches in s' foot 


E. 


square inches in the area 
of this page 


C. 


cups of water in a bowl 







8. Geometric figures which are the same size and shape are 

A. equal D. symmetric 

B. equivalent E. congruent 

C. proportional 

9* Which of these shows the meaning of Inverse operations? 

A. 3 - 3 - 0 D. (3 + 5) -5 - 3 

B. 3 + 0-3; 3-0-3 B. (3 + 5) + 0 ■ 3 + (5 + 0) 

C. 3 + 5 - 5 + 3 





O 
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I 




1 

\ 

10. If a, b, c, d and e are whole numbers, and if a > d, b < c, e > c 1 

and a < b, which is the largest number? I 

A. a D. d 

B. b E. e 

C. c 



11. Which of these is NOT a factor of 12? 

A. 1 D. 9 

B. 2 E. 12 

C. 4 



12. The basic property used in the algorism to the 
right is Illustrated by which of the following? 

A. a(bc) ■ (ab)c 

B. a + (b +c) ■ a + (c + b) 

C. a(b + c) ■ eb + ac 

D. a + b+ c»c+b + a 

E. abc ■ eba 



432 
x 2 
4 
60 
800 
864 








14. The eqyallty 2 x (3+4) * 2 + (3x4) Is an illustration of which 
of the following principles? 

A. The associative law of addition 

B. The commutative law of addition 

C. The distributive law of multiplication with respect to addition 

D. The commutative law of multiplication 

E. None of these 



15. The column which is shaded in 
the table shows that 

A. n + 0 * n 

B. n x 1 ■ n 

C. n x 0 ■ 0 

D. n * n ■ l 

E. n + r ■ r + n 





0 


l 


2 


3 


4 


0 


in 


* l 


2 


3 


4 


1 


III 


2 


3 


4 


5 


2 


$2$ 

P&M 


3 


4 


5 


6 


3 


:St J .vi 


4 


5 


6 


7 


4 




5 


6 


7 


8 
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1 . Which of these is NOT a factor of 12? 

A. 1 D. 9 

B. 2 E. 12 

C. 4 



> 



2 . Which number sentence would most appropriately be solved by division? 

A. n x 8 * 24 D. n x 8 ■ 8 x n 

B. 3 x 8 = n E. n + 8 + 8 ■ 24 

C. 8 x 3 ■ n x 3 



3. Which statement about geometric, figures is false? 

A. a cube has 8 faces 

B. two congruent triangles are similar 

C. two perpendicular lines form four right angles 

I 

| D. if the foci of an ellipse coincide, the ellipse is a circle 

G. a triangle with sides 3, 4, and 5 is similar to one with sides 
9, 12, and 15 

I 

i 

I 

► 

4. The basic property used in the algorism to the 
right is illustrated by which of the following? 

I 

f A. a(bc) * (ab)c 

B. a + (b +c) = a + (c + b) 

C. a(b + c) ■ ab + ac 



D. a + b + C"c + b+ a 
G. abc - cba 

i 








5. Geometric figures which are the same size and shape are 

A. equal D. symmetric 

B. equivalent E. congruent 

C. proportional 




7i If i, b, c, d and e are whole numbers, and If 
and a < b, which Is the largest number? 



a>d, b<c, e > c 



A. a D. d 

B. b E. e 

C. c 



8 • Which of the following Is exact? 

A. pounds a boy weighs 

B. Inches In a foot 

C. cups of water In a bowl 



Finding out the number of 

D. miles between two cities 

E. square Inches In the area 
oi this page 



9-. The equality 2 x (3+4) ■ 2 + (3x4) Is an Illustration of which 
of the following principles? 

A. The associative law of addition 

B. The commutative law of addition 

C. The distributive law of multiplication with respect to addition 

D. The commutative law of multiplication 
B. None of theae 
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10. Which number sentence represents this story problem: 

"Carlos has 40 pennies in his coin collection. He can put 8 
pennies on each page of his coin book. How many pages can 
he fill!" 



A. 


n x 8 ■ 40 


D. 


8 t n ■ 40 


B. 


8 + n - 40 


E. 


40 - 8 ■ n 


C. 


8 x 40 - n 






11. 


•••• •• 


• 


• » 



The equality of the arrays above illustrates which of the following 
properties? 

A. Commutative property of addition 

B. Commutative property of multiplication 

w . Associative property of addition 

D. Associative property of multiplication 

E. Distributive property of multiplication with respect to addition 



12. Which of the following ratios is not equivalent to the others? 



A. 



4 

6 



D. 



12 

18 



B. 



6 

9 



E. 



18 

27 



C. 



_9 

12 



What number property explains why the 
multiplication table is symmetric about 'Sc 

the dotted line? 


0 


1 


2 


3 


4 


0 

A. n x 0 ■ 0 — __ 


'o 

\ 


0 


0 


0 


0 


1 

B n v 1 ■ n — 


0 


\ 

1 

N 


2 


3 


4 


aj • *• «■ a as 

2 

G*. n t n ™ 1 


0 


2 


\ 


6 


8 


3 

n, d x r ■ r x n 


0 


3 


6 


\ 


12 


4 

E. none of these 


0 


4 


8 


12 


\ 



77 



82 



O 



Which of the following 


pairs 


of sentences are equivalent? 


(I) 


8 + n - 13 


and 


13 - 8 - n 


(II) 


7 + n - 10 


and 


10 •• n • 7 


(III) 


n + 3 - 9 


and 


‘19 - 13 - n 


A. only I 






D< only II and III 



B. only I and II E. 1, II and III 

C. only I and III 



15. Which figure below does NOT show a line of symmetry? 
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Basic Mathematics 



Questions 16-35 



16. Which of the following number sentences are equivalent to the sentence 
whose model is shown on this number line? 



4 -• ♦ ••••• 

0 1 2 3 4 S 6 7 





(a) 


N = 


7 + 5 


(c) 


N + 5 - 7 




(b) 


N * 


7 - 5 


(d) 


7 - N « 5 


A. 


Only 


(a) 


and (b) 


0 . 


Only (b), (c) and (d) 


B. 


Only 


(b) 




F.. 


All of these 


C. 


Only 


(b) 


and (c) 
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17. If x and y are positive even Integers and If p and q are positive odd 
Integers, which of the following Is FALSE? 

A. x + y Is a positive even Integer D. pq Is a positive odd Integer 

B. p + q Is a positive odd Integer E. px Is a positive even Integer 

C. xy Is a positive even Integer 

Questions 18 and 19 refer to the addition exercise below: 

. 672 - 6 hundreds + 7 tens + 2 ones 

834 - 8 hundreds + F tens 4- 4 ones 

Q hundreds+10 tens + 6 ones 

- R thousands + S hundreds + T tens + U Ones 
■ R, S T U (Final answer) 

18. F - 



A. 


8 


D. 


34 


B. 


3 


E. 


834 



G. 83 

19 . In the final answer , R, S T U represents : 

A. The product of the numbers R, S, T and U 

B. The sum of the numbers R, 8, T and U 

C. (R x 1000) + (S x 100) + (T x 10) + (U x 1) 

D. (R x 1) + (S x 10) + (T x 100) + (Dx 1000) 

E. Eleven thousand, five hundred six 

20. In order to find the product 6 x 9 we might: 

A. Form the union of two disjoint sets with six and nine members 

B. Form a six by nine array 

C. Use the division algorithm 

D. Notice that (6 x 9)b M# io ■ 3 ten x (6^^ x 9 t |j rge ). 




E. 



Draw a triangle with sides 6" and 9" long. 



80 



66 



GPO 127-794—7 



21. 



5 
j 4 
20 

Which of Che following checks of Che computation above 
makes direcc use of Che commutative propercy? 

C. 5 D. 4 E. 4 
5 4 _j. 

5 4 20 

_5 4 

20 _4 

20 



A. 4 



20 

0 



B. 



4 

J20" 

m 

0 



I 

i 

l 

1 



i 



22. 



4 x 376 « (4 X 300) + □ + (4x6) 



WhaC number goes in place of □ above? 



A. 12 D. 

B. 24 E. 

C. 28 



240 

280 



23. Which of the poincs A, B, C, D or E on chis number line can be named by 
the fraction 5 ? 

8 



0 A B ECU 1 



24. Choose the best way to complete this statements Standard 

units of measurement are used because 

A. It Is Important for people to use the same unit in 
dealing with each other. 

B. standard units give more accurate measurements than 
units which are not standard. 

C. people have always used them. 

D. they are all related to base 10 numeration. 

E. the English system Is more natural than the metric 
system . 

a 81 

O 
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25 . 



3 Jl7 




12 


4 


15 




~JS 


k 


9 




-2 


3 


0 


9 



If the algorism above Is based on interpreting division as successive 
subtraction, then k - 



A. 2 D. 6 

B. 3 B. 9 

C. 5 



26. Suppose I is 

1 I 1-0 

2 1 2-3 

5 _L_ 6-29 

What Is 6 I 3 ? 

A. 6 

B. 3 

C. 9 



binary operation wLth 

7 I t - 13 

4 J__ >f - 15 
9 1 2-17 

D. 17 
K. 18 



27. 



The Inverse operation for addition 1st 

A. addition D. 

B. subtraction B. 

C. multiplication 



division 
none of these 



28. A point P lies 4.03 Inches from the center of a circle with a radius of 4.3 
Inches. Which of the following Is true? 



A. P Ues outside the circle 

B. P lies at the center 

C. P lies Inside the circle, but 
not at the center 



D. P llee somewhere on the 
circumference 

B. Zt cannot be determined whether 
f lies Inside, on, or outside 
the circle 
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If x, y, x are numeral* In ba»a five notation, which of the following are 
correct? 



(a) x + y » y + x 

(b) x (y + z) » xy + x* 

(c) If x < y and y < z then x < z 

A. Only (a) D. Only (a) and (c) 

B. Only (b) E. (a), (b), and (c) 

C. Only (a) and (b) 



32. If A and B are two sets which can be matched (put In one-to-one correspondence 



then: 

A. A and B must both be sets of numbers 

B. A and B must have the same number of elements 

C. Neither A nor B can be the empty set 

D. A and B must both be sets of points 

E. A and B must each have one member 



) 



33. Which of the following Is the multiplicative Inverse of 4.0? 

A. 0.04 D. 0.3 

B. 0.25 E. 1.25 

C. 0.4 



34. Which one of the following division examples will result In the quotient 25.2? 



A. 5J TISF 

B. .57 .12b 

C. .05 J TTS5 



D. .0057 TT5S 

E. .0005) TI2E 
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A football team start* th* following series of play* from it* own 
20-yard line: gain* 8 yard*, lot** S yard*, loses 1 yard, gain* 6 

yards. On what yard Una 1* th* ball now? 



A. 


11 


D. 


34 


B. 


26 


E. 


37 


C. 


31 







When you have finished, please check to make sure you have answered 
all questions on the questionnaire and on this test. Then hand In 
this booklet along with your honorarium form. 



Thank you for taking part in this project. 
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Appendix F 

Additional Statistical Tables and Figure 
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Table 1-F 

Sample Mean Scores by Treatment by Site (Obtained from Averages over Grade) 
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Table 2 -F 

Weighted Mean Univariate Analysis of Variance, with Grade as Repeated Measure Within School 
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Fig. 1-F, Performance levels on knowledge and attitude 

variables for experimental and control teachers: 
Sample data. 
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